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The  Cultural  Revolution 


Presenter:  Dean  T.  Kashiwagi,  is  a  professor  at  Arizona  State  University’s  Del  E  Web  School  of 
Construction  and  the  Director  of  the  Performance  Based  Studies  Research  (PBSRG)  since  1992. 
PBSRG  is  the  worldwide  leader  in  improving  construction  performance  and  efficiency.  Kashiwagi  has 
developed  a  “hands  off”  approach  to  managing  contractors/vendors  in  the  construction  industry  or  in  any 
industry.  His  concept  is  contrary  to  traditional  price-driven  construction  procurement.  It  forces  the 
contractor/vendor  to  be  accountable — in  other  words,  minimizes  risk  for  the  facility  owner.  The 
technology  has  been  tested  over  450  times  totally,  using  $521 M  in  construction  projects  with  a  98% 
success  rate  (on  time,  on  budget,  and  high  quality).  This  is  one  of  the  few  documented  processes  that 
brings  better  value  for  the  owner  and  maximizes  the  profit  of  the  contractor.  It  is  currently  being  tested  in 
other  professional  areas  outside  of  construction. 

Presenter:  Nathan  B.  N.  Chong,  Chief,  Facility  Life  Cycle  Management  Division,  US  Army  Medical,  has 
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the  implementation  of  Performance  Information  Procurement  System  (PIPS)  within  the  Army  Medical 
Facility  acquisition  system.  His  career  objective  is  to  improve  the  Army  medical  design  and  construction 
processes. 
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Abstract 

The  culture  within  the  Federal  Government  Acquisitions  is  based  on  the  Federal 
Acquisition  Regulations  (FAR)  and  its  interpretation,  often  placing  organizations/agencies  in  the 
cultural  environment  of  the  price-based  environment.  In  the  healthcare  system,  clients  depend 
on  the  qualifications  and  expertise  of  the  design  and  construction  team  to  meet  their  specific 
needs  and  requirements.  The  hiring  criteria  of  these  experts  have  been  primarily  based  on  low 
bid  or  relationships,  and  have  continuously  resulted  in  poor  performance.  The  US  Army 
Medical  Command  (MEDCOM)  (contracting  approximately  $100M  in  medical  renovation  awards 
per  year)  partnered  with  the  Performance  Based  Studies  Research  Group  (PBSRG)  at  Arizona 
State  University  to  create  and  test  an  information  environment  to  assist  in  alleviating  some  of  its 
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cultural  inefficiencies.  The  developed  information  environment  minimized  the  flow  of 
information,  forced  the  contractors  to  concentrate  on  value  and  the  assumption  of  risk,  and 
stimulated  an  atmosphere  of  accountability.  Through  the  system,  the  client’s  internal 
bureaucratic  resistance  was  minimized;  and,  without  controlling  the  various 
contract/procurement  processes,  MEDCOM  leadership  has  gained  control  of  the  performance  of 
their  infrastructure  revitalization  program  by  implementing  a  cultural  environment  of  information. 

Keywords:  Federal  Acquisition  Regulations  (FAR),  US  Army  Medical  Command 
(MEDCOM),  information  environment,  cultural  inefficiencies 

Introduction 

The  Performance  Based  Studies  Research  Group  (PBSRG),  experts  in  the  area  of 
performance  information,  has  used  the  Construction  Industry  Structure  (CIS)  diagram  to  define 
and  compare  the  characteristics  of  the  high-competition  environments:  Price  Based  and  Value 
Based  (Figure  1 ).  The  best-value  environment  focuses  on  securing  the  best-value  vendor  for 
the  owner  and  on  transferring  all  project  risk  to  the  outsourced  expert.  It  considers  the  vendor’s 
past  performance,  ability  to  identify  and  minimize  risk,  preplanning  foresight,  and  project 
knowledge.  It  requires  the  contractors  to  use  their  expertise  to  complete  a  project  that  fulfills  the 
intent  of  the  owner,  and  minimize  controlled  project  risk  at  the  beginning  of  the  project.  It  forces 
accountability  between  all  parties,  and  benefits  vendors  with  foresight,  experience,  skill,  and 
efficiency.  It  provides  an  environment  that  maximizes  contractor  profit,  while  minimizing  owner 
resources. 

In  contrast,  the  price-based  environment  focuses  on  using  minimum  standards  to  define 
the  requirement  of  the  contract,  in  order  to  ensure  that  the  minimal  requirement  is  met.  Due  to 
its  concentration  on  price,  it  encourages  the  contractors  and  vendors  to  translate  the  minimum 
requirement  to  a  maximum  in  attempts  to  lower  the  quality  of  the  delivered  product  to  gain  the 
competitive  advantage.  This  penalizes  the  high  performers  who  can  see  the  prospective  project 
from  a  visionary  view,  from  beginning  to  end,  and  seeks  to  minimize  change  orders  by  pricing  in 
items  which  will  need  to  be  done  that  are  missing  from  the  specifications.  It  discourages  the 
use  of  expertise,  and  asks  the  contractor/vendor  to  price  only  what  is  written — ignoring  the 
owner’s  intent.  It  promotes  project  dependency  on  change  orders  when  the  unspecified  or  client 
“unexpected”  events  occur  during  project  execution.  The  price-based  environment  gives 
inexperienced  contractors  the  competitive  advantage  over  experienced  contractors,  thus  driving 
the  experienced  contractors  to  move  from  a  position  of  minimizing  risk  to  a  position  of  ignoring 
project  risk.  This  culture  results  in  the  contractor  relying  on  the  client  to  manage,  direct,  control, 
and  inspect,  and  become  reactive  instead  of  proactive.  This  trend,  which  is  clearly 
demonstrated  in  Figure  2,  has  the  following  ramifications: 

1 .  Penalizes  contractors  who  carefully  preplan,  understand  the  scope  of  the  project,  and 
price-out  the  project. 

2.  Motivates  contractors  to  take  the  low  price  at  the  last  minute,  not  knowing  whether  they 
are  meeting  the  specifications,  and  when  receiving  the  award,  further  price  shopping  to 
ensure  that  they  can  meet  the  specifications  for  the  lowest  possible  price. 

3.  Encourages  all  manufacturers  to  ensure  that  their  products  meet  only  the  lowest 
possible  quality  to  get  the  largest  possible  volume  sales  of  contractors  trying  to  get  the 
lowest  price. 
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4.  Promotes  the  bypass  of  education  and  personnel  training  in  the  industry,  leading  to  a 
critical  shortage  of  trained  personnel. 

5.  Leads  to  poor  construction  performance  (not  on  time,  not  on  budget,  and  not  meeting 
the  client’s  expectations). 


High 
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Qualified  vendors  invited 

Owner  selects  vendor 

Negotiates  with  vendor 

Vendor  performs 
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Figure  1.  Construction  Industry  Structure  (CIS) 

(Kashiwagi,  2004) 
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Figure  2.  Impact  of  Price-based  Bidding:  Increase  of  Risk 

(Kashiwagi,  2004) 


Relative  Analysis  of  the  Two  Environments 

A  relative  analysis  of  the  two  environments  (price  based  and  best  value)  leads  to  the 
following  deductive  conclusions.  Performance  can  only  occur  when  risk  is  transferred  to  an 
entity  that  has  the  capabilities  of  minimizing  the  risk.  The  best-value  environment  ensures  high 
performance  by  transferring  risk  to  the  best-value  contractor  who  can  verify  past  performance, 
send  their  best  personnel,  identify  risk  that  they  control  and  do  not  control,  and  develop  a  plan 
to  minimize  the  risk  that  they  do  not  control.  The  owner’s  resulting  risk  in  this  environment 
(assuming  that  the  client  did  pick  the  best  value — highest  performer  for  the  lowest  price),  is  the 
interface  or  the  seam  between  the  client  and  the  contractor,  or  in  other  words  the  risk  that  the 
contractor  does  not  control  (Figure  3).  Alternatively,  the  price-based  environment  passes  risk  to 
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the  contractor  with  the  lowest  price  without  ensuring  that  they  can  minimize  the  risk,  hence:  the 
poor  performance  of  the  construction  industry. 

When  risk  is  transferred  to  a  party  unable  to  minimize  the  risk,  the  party  must  be 
managed,  inspected,  and  controlled.  In  consequence,  the  owner’s  risk  in  the  low-price 
environment  is  the  potential  that  the  minimally  trained,  managed,  and  directed  contractor/vendor 
may  not  do  what  they  are  directed  to  do  (Figure  3).  The  price-based  environment  has  reflected 
this,  in  a  heavy  overhead  for  transaction  costs  relating  to  management,  direction,  control, 
inspection,  and  communications  that  would  be  eliminated  if  the  client’s  process  were  more 
efficient.  This  has  also  translated  to  a  higher  requirement  of  people  needed  to  maintain  the 
system  (due  to  the  inefficiency  of  the  process).  Accordingly,  there  is  more  confusion  in  the 
price-based  environment  due  to  the  management,  decision-making,  unrealistic  expectations, 
attempts  to  control  others,  use  of  leverage  (making  a  party  do  free  work  or  work  that  they  are 
incapable  of  doing),  and  the  lack  of  performance  information  of  key  individuals,  contractors,  and 
the  client’s  personnel.  Without  simple,  easy-to-understand  measurements  that  consider  the 
vendor’s  capabilities,  the  price-based  environment  is  adversarial:  where  every  participant, 
regardless  of  whom  they  work  for,  protects  themselves  before  they  protect  the  company  they 
work  for,  or  the  client/user  for  whom  the  construction  is  being  built. 


Low  Bid 


Client 


Procurement 


(^Designer^) 

(OQ  Vended 

(Subcontractor) 


Best  Value 


Figure  3.  Difference  in  Risk  Between  Price-based  and  Best-value  Environments 


The  above  characteristics  are  supported  by  documentation  of  construction  delivered  by 
the  price  based  environment  (AGC,  2005;  Butler,  2002;  CM,  2005;  Doree,  2004;  Fitz-Gibbon  et 
al. ,  2006;  Guo,  2006;  Markus,  1997;  NDU,  2005;  Post,  1998;  State  of  Hawaii,  2002).  The 
characteristics  identify  management  as  the  key  component  to  the  price-based  environment;  and 
leadership,  or  the  alignment  of  resources  that  can  minimize  risk  as  the  key  component  to  the 
best-value  environment.  The  understanding  of  the  Construction  Industry  Structure  (CIS)  and 
the  impact  of  the  price-based  bidding  identifies  the  following  leadership/management 
characteristics  as  well  as  the  projected  goal  of  personnel  who  are  trying  to  move  from  the  price- 
based  environment  (management  and  control)  to  the  best-value  environment  (leadership): 

Management 

1.  Focus  on  relationships 
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2.  Lack  of  performance  information  on  critical  elements  of  the  contractor’s  team  (relative 
ability  to  finish  on  time,  on  budget,  and  meet  the  client’s  expectations) 

3.  Direction/Control  by  client’s  personnel 

4.  Decision-making  performed  by  client’s  personnel  instead  of  contractor  personnel 

5.  Maximum  communication/documentation  passed  between  client  and  contractors 

6.  Duplication  of  cost  estimates  quantities  and  approvals 

7.  Passing  of  risk  without  regard  to  relative  ability  to  minimize  risk 

8.  The  most  important  person  in  the  process  becomes  the  client’s  procurement  agent — 
although  they  have  no  technical  expertise  and  take  no  responsibility  for  cost  or  time 
overruns 

Leadership 

1 .  Performance  information  used  to  minimize  decision-making 

2.  T ransfer  of  risk  to  those  that  can  minimize  risk 

3.  Replacement  of  the  client  management,  direction,  and  inspection  with  contractor/vendor 
self-  documentation/regulation 

4.  Minimization  of  client  decision-making,  documentation,  and  flow  of  information 

5.  Process  installed  to  ensure  that  the  best-value  contractors/vendors  know  how  they  will 
minimize  risk 

6.  Contractors/vendors  address  performance  and  risk  in  terms  of  value  chain,  supply  chain, 
and  overall  transaction  costs 

Information  Measurement  Theory  and  Best  Value  Test  Results 

PBSRG  has  been  testing  best-value  procurement  using  an  information  based 
Performance  Information  Procurement  System  (PIPS).  PIPS  is  built  on  a  foundation  of 
principles  outlined  by  the  Information  Measurement  Theory  (IMT).  IMT  is  a  set  of  deductive 
logic  models  which  predict  future  results  based  on  relative  measurements.  The  following  are 
the  major  concepts  or  models  (Kashiwagi,  2004): 

1 .  Decision-making  requires  individuals  to  use  their  subjective  bias  and  experience  to  solve 
a  situation  in  which  they  have  insufficient  information  to  predict  an  outcome. 

2.  Decision-making  brings  risk. 

3.  Decision-making  is  minimized  when  the  decision-maker  has  accurate  information. 

4.  Dominant  information  is  information  that  will  minimize  the  need  for  decision-making. 

5.  It  is  difficult  for  one  organization/person  to  control  the  actions  of  another  individual. 

6.  People  and  organizations  are  predictable  with  enough  information. 

7.  Past  performance  and  future  capability  to  perform  on  unique  events  can  be  predicted. 

8.  Experienced  personnel  can  identify  future  activities  in  an  event  before  it  happens.  They 
can  identify  and  prioritize  risk,  and  they  will  have  a  plan  to  minimize  the  risk  before  it 
happens. 


ACQUISITION  RESEARCH:  CREATING  SYNERGY  FOR  INFORMED  CHANGE  -  431  - 


The  following  test  results  and  measurements  of  PIPS  have  validated  the  above 
concepts: 

1 .  Duration  of  testing:  1 3  years. 

2.  Research  Funding:  $6.2M 

3 .  N  u  m  ber  of  tests :  480 

4.  Construction  volume/scope  of  tests:  $500M 

5.  Largest  projects:  $100M  City  of  Peoria  Wastewater  Treatment  DB  project  (2007)  and  the 
$53M  Olympic  Village/University  of  Utah  Housing  Project  (2001) 

6.  Performance  of  contractors  in  tests  (on  time,  on  budget  with  no  contractor-generated 
cost  change  orders,  meeting  client’s  expectations):  98% 

7.  Surprise  factor  of  nonperformance:  Less  than  1% 

8.  Management  effort  of  client’s  construction  managers:  minimized  by  80  to  90% 

(University  of  Hawaii  (2000)  and  University  of  Minnesota  (2006),  and  the  ability  of  project 
managers  to  deliver  10  times  the  amount  of  projects  (State  of  Hawaii  (1997-2001) 

9.  Awards:  2005  Corenet  Global  Innovation  of  the  Year  Award  for  testing  at  Harvard 
University,  and  the  2000  Tech  Pono  Award  for  the  testing  at  the  State  of  Hawaii 

10.  Clients  in  the  Public  Sector:  FAA,  US  Army  Medical  Command,  USCG,  States  of 
Washington,  Wyoming,  Utah,  Georgia,  Hawaii,  and  Missouri,  City  of  Peoria,  AZ,  City  of 
Miami  Beach,  and  Universities  (University  of  Hawaii,  Arizona  State  University  and 
University  of  Minnesota) 

11.  Clients  in  the  Private  Sector:  General  Dynamics,  Raytheon,  Schering  Plough,  United 
Airlines,  Motorola,  Honeywell,  IBM,  Boeing,  Intel,  and  International  Rectifier 

12.  Risks  and  Reason  for  Stopping  PIPS:  the  champion/expert  of  Best  Value/PIPS  moves  or 
retires,  political  change,  someone  in  the  organization  feels  threatened  and  stops 
process,  organization  is  too  inefficient,  ineffective,  and  bureaucratic  to  make  process 
work 

Theoretical  Concepts  of  Best  Value 

The  Best  Value/PIPS  process  (shown  in  Figure  4)  is  composed  of  three  primary  steps: 

1 .  Selection  Phase  (Filter  1-4):  Identification  of  the  Best  Value 

2.  Preplanning  /Quality  Control  Phase  (Filter  5):  Forcing  the  best  value  to  preplan  and 
minimize  risk  that  they  control  and  do  not  control  through  a  PIPS  Quality  Control  Plan  or 
Risk  Plan  and  schedule 

3.  Risk  Management  Phase  (Filter  6):  Management  of  the  construction  project  through  risk 
minimization 

The  selection  phase  attempts  to  differentiate  the  performance  and  expertise  of 
competing  vendors.  This  is  done  through  the  collection  of  each  contractor’s  past  performance 
information  (from  key  individuals  as  well  as  the  general  contractor  and  critical  subcontractors), 
risk-assessment/value-added  plan,  and  interview  ratings.  It  is  important  to  note  that  if  the 
contractors  cannot  differentiate  themselves  through  their  past  performance,  identification  of 
project  risk  out  of  their  control,  plans  to  minimize  uncontrolled  risks,  value  added  options,  and 
interview,  there  is  nothing  wrong  with  awarding  the  project  based  on  the  best  price  (as  the 
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contractors  proved  they  are  all  the  same).  The  client  should  not  make  decisions  to  assist  any 
contractor  to  become  competitive.  No  contractor  should  be  assisted  by  being  given  a  second 
chance,  redoing  their  cost  estimate,  or  given  information  from  other  contractors  that  could 
possibly  make  them  more  competitive.  In  best  value,  every  contractor  is  competitive,  and  every 
contractor  has  a  chance  to  differentiate  themselves  without  biased  assistance  from  the  client’s 
representative. 
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Information  Plan 


Filter  3  Filter  4 

Interview  Prioritize 


Filter  5  Filter  6 

Pre-Award  Weekly 

Period  Report 

Post- Rating 


Figure  4.  Best  Value  Natural  Selection 

(Kashiwagi,  2004) 

The  Best  Value/PIPS  process  forces  the  best-value  contractor  to  take  its  price,  risk- 
assessment/value-added  plan  and  interview  statements  into  the  second  phase  of 
Preplanning/Quality  Control.  In  the  preplanning/PIPS  Quality  Control  Phase,  the  contractor 
concentrates  on  minimizing  the  project  risks.  A  schedule  listing  the  major  milestones  in  the 
project  is  developed.  A  QC  plan  is  also  compiled  by  the  contractor  which  includes  a  list  of  risks 
out  of  the  contractor’s  immediate  control  in  conjunction  with  a  detailed  plan  to  minimize  each 
risk.  Technical  risks  are  not  included,  as  the  contractor  minimizes  risks  that  it  controls  by 
meeting  the  requirements  of  the  specification.  Only  after  the  owner  is  satisfied  with  the  pre¬ 
planning  performed  by  the  contractor  will  the  contract  be  awarded. 


Once  the  project  has  been  initialized,  the  contractor  enters  the  Risk  Management  Phase. 
Every  week  during  project  execution,  the  contractor  is  required  to  submit  a  Quality  Assurance 
(QA)  plan  and  Weekly  Report  to  the  owner.  The  QA  plan  is  a  checklist  of  the  risks  identified  in 
the  previous  phase  that  ensures  that  each  risk  is  being  monitored  and  minimized  according  to 
the  directives  included  in  the  QC  plan.  If  the  risk  cannot  be  minimized  according  to  client  pre¬ 
approved  QC  efforts,  the  risk  is  reported  on  the  weekly  report  along  with  unforeseen  risks 
adversely  impacting  the  schedule  or  budget.  The  client  is  then  obliged  to  pay  for  additional  time 
and  effort  (Figure  5).  This  process  transfers  the  risk  to  the  contractor,  who  then  uses  the 
mechanism  of  the  QC  plan  to  make  all  parties  accountable  thorough  communication, 
coordination,  and  preplanning. 
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Unforeseen  Risks 


QUALITY  CONTROL 

•  Risk  . 

•  Risk  Minimization 

•  Schedule 
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Unforeseen  Risks 


QUALITY  ASSURANCE 

DIRECTOR’S  REPORT 

•  Checklist  of  Risks 

•  Vendor  Performance 

•  Sign  and  Date 

•  Client  Performance 

•  Individual  Performance 

\ _ > 

•  Project  Performance  ^ 

Figure  5.  Information  Environment 

The  selection  process  ensures  the  procurement  of  the  best-value  contractor  and  the 
transfer  of  all  project  risk  to  the  contractor.  The  QC  plan  and  the  weekly  risk  report  then  defend 
the  high-performing  contractor  by  identifying  risks  out  of  the  contractor’s  control  and  the 
contractor’s  limited  abilities  to  impact  the  risk.  Because  it  is  reviewed  by  the  client’s 
representative,  the  information  is  usually  very  accurate.  The  QC  plan,  QA  checklist,  weekly 
report,  and  schedule,  also  help  to  regulate  the  contractor’s  work.  All  the  elements  are 
incorporated  into  the  contractor’s  contract  on  award.  At  the  end  of  the  project,  the  contractor  is 
rated  by  the  owner,  and  the  rating  modifies  the  past  performance  rating  of  the  contractor  by 
50%  (Figure  6). 


Figure  6.  Best  Value  DMAIC  Closed  Loop 

(Kashiwagi,  2004) 

Information  System 

The  owner  is  able  to  compile  a  group  of  individual  contractor  weekly  reports 
(spreadsheets  submitted  to  the  client  weekly)  into  a  Director’s  Report  (Figure  7)  which  can  give 
a  Facility/Construction  director  valuable  measurements  of  risk/performance  for  the  organization 
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as  a  whole,  as  well  as  a  prioritization  of  the  risks.  The  Director’s  Report  also  allows  for  the 
comparison  of  contractors,  project  managers,  project  integrators,  inspectors  or  design 
professionals  involved  in  the  projects.  The  report  provides  accurate,  timely  risk/performance 
information  that  disables  bureaucracy  and  identifies  where  risk  is  being  created.  For  the  first 
time,  it  gives  a  director  a  simplistic  information  system  with  minimal  maintenance  that  deters 
nonperformance  by  highlighting  nonperformance  quickly  and  accurately. 


UNFORESEEN  (UF)  &  OWNER  (O)  RISK 


#  UF  Risks  affecting  budget/schedule 

0 

Days  Delayed  (Calendar) 

0 

Additional  Cost 

$ 

#  0.  Risks  affecting  budget/schedule 

1 

Days  Delayed  (Calendar) 

0 

Additional  Cost 

$  2,000.00 

CONTRACTOR  RISK 

#  of  Unaddressed/Overdue  Risks 

1 

#  Unrated  Risks 

0 

#  Risks  affecting  budget/schedule 

2 

Risk  to  Schedule  (calendar  days) 

15 

Risk  to  Cost 

$  1 ,000.00 

Contractor  Satisfaction  Rating 

10.0 

OVERALL  CURRENT  STATUS 

Days  Delayed  (Calendar  days) 

5 

%  Delayed 

0.8% 

Contractor  %  Delayed 

0.8% 

Additional  Cost 

$  2,000.00 

%  Over  Award 

9.2% 

Contractor  %  Over  Award 

0.0% 

Project  Satisfaction  Rating 

10.0 

Risk  Number 

1.16 

7.1  Individual  project  performance 


TOP  10  RISK  RANKING  PROJECTS 

No. 

Project 

Risk# 

1 

Design  for  Two  HVAC(s)  &  Windows 

52.94 

2 

Tpe  III  WP 

17.71 

3 

WP  Replace  C  Tower  HVAC  Sys 

13.61 

4 

Rpr/Rpl  Elec  Distr  Sys 

11.91 

5 

Renew  Troop  Medical  Clinic 

11.07 

6 

Fire  Damage  Repair 

10.51 

7 

Construct  Hyperbaric  Chamber 

10.50 

8 

Fault  Current  &  Over  Dev  CS 

10.35 

9 

Convert  Warehouse  to  Admin.  Area 

10.10 

10 

WP  Fire  Protection  Upgrade 

10.07 

7.3  Risk  ranking  of  projects 


DIVISION  OVERVIEW 

11/03/06 

Tolal  Awarded  Budget 

'SI  72,751 .944.23 

Current  Cost 

'$174,484,794.47 

Over  Budget 

Si  ,732,850.24 

PROJECT  OVERVIEW 

Tolal  Number  of  Projects 

IIS 

%  Projects  On  Time 

65% 

-  of  Jobs  Delayed 

17 

%  Projects  On  Budget 

as% 

-  of  Jobs  Over  Awarded  Budget 

16 

#  of  Projects  Miss  nq  Owner  Ratings 

0 

AVERAGE  PROJECT 

Project  Budget 

^  £  1  483  240  30 

#  of  Risks  per  Job 

3.14 

Owner  Generated  Risks 

1.66 

Number  of  overdue  risks 

0.25 

%  Over  Awarded  Budget 

3.39% 

%  over  budget  due  to  owner 
#  of  Days  Delayed 

3.23% 

8.76 

#  of  days  delayed  due  to  owner 

7.62 

Owner  Rating 

9.17 

Risk  Number 

2.42 

7.2  Overall  organization  performance 


CONTRACTOR  OVERVIEW 

Contracto  r  A 

Contractor  B 

Contractor  C 

Tolal  Awarded  Budget 

S1S.725.0S3 

$52,274,179 

;  S  2  H05  433 

Gurrenl  Cost 

S16.4S0.244 

562.274.173 

I  S  2.005.433 

QVERVI EW  OF  PRO JEC  TS 

ToSal  Number  or  Presets 

18 

6 

~  of  J  obs  Delayed 

4 

2 

4 

s  of  Jabs  Over  Awarded  BudgeE 

i 

0 

0 

AVERAGE  PROJECT 

| 

%  Over  Awarded  Budget 

13,93% 

0.00% 

S  of  Da  vs  Delayed 

6.84 

2,33 

9.50 

Owner  Rating 

S  C3 

5  S3 

10.00 

Risk  Number 

4.15 

2.94 

2.41 

7.4  Comparing  vendor  performance 


Figure  7.  Director’s  Report 


Implementation  of  Best  Value/PIPS  in  the  US  Medical  Command 
(MEDCOM) 

In  order  to  implement  Best  Value/PIPS  into  the  US  Medical  Command  (MEDCOM),  the 
system  was  adjusted  in  order  to  assure  compatibility  with  the  FAR  and  AFARS.  As  a  result,  the 
following  changes  were  made: 

1 .  The  preplanning/quality  control  period  is  performed  during  a  preconstruction  period  after 
the  award  of  the  contract. 

2.  The  technical  and  non-technical  concerns  of  the  client/user  are  given  to  all  contractors. 
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The  Best  Value/PIPS  process  can  be  implemented  on  Design-Build,  CM@Risk,  Design- 
Bid-Build,  IDIQ  contracts,  or  on  designers.  The  US  Army  Medical  Command  has  implemented  it 
on  IDIQ  contracts,  and  directed  the  contractors  to  use  a  best  value  process  that  includes 
preplanning,  Quality  Control  that  minimizes  risk  that  the  contractor  does  not  control,  weekly  risk 
reporting,  and  client  identification  of  contractor  performance. 

Once  the  IDIQ  contractors  had  been  educated  in  the  Best  Value  process,  they  began  to 
realize  that  it  would  assist  them  to  be  more  efficient,  make  the  client’s/user’s  representatives 
accountable,  and  maximize  their  profits  without  charging  more  (win-win).  The  contractors 
began  to  realize  that  the  process  was  a  very  successful  enterprise  model  that  used  best 
business  practices,  motivated  their  personnel  to  improve,  and  measured  their  own  performance. 
The  majority  of  the  contractors  began  requesting  their  personal  performance  measurements. 

The  US  Army  Medical  Command  effort  has  grown  in  stages: 

1 .  First  stage:  MEDCOM  officials  supported  the  system,  instituted  training  sessions  for  their 
own  personnel,  and  introduced  the  contractors  to  the  process  (duration  of  1  year). 

2.  Second  stage:  MEDCOM  instituted  the  system  into  their  specifications,  making  it  a 
requirement  to  select  on  best  value,  preplan  the  minimization  of  risk,  implement  a 
contractor  generated  QC  plan,  and  measure  performance.  Five  out  of  a  potential  seven 
IDIQ  contractors  attended  the  annual  Best  Value  conference,  which  included  detailed 
training  of  the  system,  at  their  own  expense.  The  contractors  viewed  it  as  a  process 
required  when  working  with  MEDCOM  (duration  of  1  year). 

3.  Third  stage:  The  information  environment  and  Director’s  Report  were  instituted. 
Performance  information  was  returned  to  the  IDIQ  contractors  on  both  project 
performance  and  ongoing  risk  minimization.  The  contractors  noted  that  the  Best 
Value/PIPS  structure  allowed  them  to  perform,  differentiate  themselves  based  on  value, 
and  increase  efficiency.  Irresolvable  project  problems  which  previously  have  migrated  to 
the  director  of  the  MEDCOM,  have  now  been  minimized  to  problems  with  easily 
identifiable  solutions.  Four  of  the  seven  contractors  generated  their  own  training  and 
measurement  systems.  Six  of  the  seven  contractors  attended  the  annual  Best 
Value/PIPS  training  education  at  their  own  expense.  One  of  the  contractors  began  using 
their  performance  information  to  educate  other  owners  on  the  efficiency  and 
effectiveness  of  the  Best  Value/PIPS  structure.  Contractors  now  view  the  Best  Value 
process  as  a  process  to  measure  themselves,  minimize  their  risk,  and  improve  their 
companies  (duration  of  1  year). 

4.  Fourth  stage  (current  stage):  Continuous  education  of  the  concepts  of  supply  chain 
optimization,  preplanning,  quality  control,  and  risk  minimization  are  being  facilitated. 

Both  the  client’s  personnel  (MEDCOM  representatives,  the  Corps  of  Engineers  (COE) 
procurement  personnel,  and  users)  and  the  contractor’s  personnel  are  learning  how  to 
maximize  the  effectiveness  of  the  system  instead  of  using  them  as  routine  additional 
duties. 
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Federal  Acquisition  Regulation  (FAR) 

The  intent  of  the  Federal  Acquisition  Regulation  {FAR)  (2002)  is  to  bring  the  government 
the  “best  value.”  In  the  delivery  of  construction,  the  FAR  recommends  sealed  bids.  However,  in 
FAR  36.103b  and  6.04(b)(1),  it  states  that  if  the  use  of  sealed  bids  cannot  effectively  deliver  the 
best  value,  the  request  for  proposal  process  using  criteria  other  than  price  can  be  used.  There 
is  ample  evidence  that  implies  the  delivery  of  construction  cannot  be  treated  as  a  commodity. 

The  term  “best  value”  is  mentioned  34  times,  and  the  term  “low  bid”  is  mentioned  19 
times  in  the  FAR.  Best  Value  means:  the  “expected  outcome  of  an  acquisition  that,  in  the 
estimation  of  the  Government,  provides  the  greatest  possible  benefit  to  the  requirement”  {FAR 
2.1).  The  benefits  include  (FAR  102.2(b)): 

1 .  Satisfy  the  customer  in  terms  of  cost,  quality,  and  timeliness  of  the  delivered  product  or 
service  by,  for  example — 

■  Maximizing  the  use  of  commercial  products  and  services; 

■  Using  contractors  who  have  a  track  record  of  successful  past  performance  or  who 
demonstrate  a  current  superior  ability  to  perform;  and 

■  Promoting  competition; 

2.  Minimize  administrative  operating  costs; 

3.  Conduct  business  with  integrity,  fairness,  and  openness 
FAR  1.102.2-1  (b)  states: 

(b)  Vision.  All  participants  in  the  System  are  responsible  for  making  acquisition 
decisions  that  deliver  the  best  value  product  or  service  to  the  customer.  Best  value  must  be 
viewed  from  a  broad  perspective  and  is  achieved  by  balancing  the  many  competing 
interests  in  the  System.  The  result  is  a  system  which  works  better  and  costs  less. 

FAR  1.102-2(b)(2)  states: 

(2)  The  System  must  provide  uniformity  where  it  contributes  to  efficiency  or  where 
fairness  or  predictability  is  essential.  The  System  should  also,  however,  encourage 
innovation,  and  local  adaptation  where  uniformity  is  not  essential. 

FAR  1 .102-4  (e)  further  states  that: 

(e)  The  FAR  outlines  procurement  policies  and  procedures  that  are  used  by 
members  of  the  Acquisition  Team.  If  a  policy  or  procedure,  or  a  particular  strategy  or 
practice,  is  in  the  best  interest  of  the  Government  and  is  not  specifically  addressed  in  the 
FAR,  nor  prohibited  by  law  (statute  or  case  law),  Executive  order  or  other  regulation, 
Government  members  of  the  Team  should  not  assume  it  is  prohibited.  Rather,  absence  of 
direction  should  be  interpreted  as  permitting  the  Team  to  innovate  and  use  sound  business 
judgment  that  is  otherwise  consistent  with  law  and  within  the  limits  of  their  authority. 
Contracting  officers  should  take  the  lead  in  encouraging  business  process  innovations  and 
ensuring  that  business  decisions  are  sound. 
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The  FAR  addresses  the  use  of  the  PIPS  filters  of  past  performance  ( FAR  15.305(a)(2)), 
the  risk-assessment  plan/value-added  plan  (FAR  15-305(a)(3)(i)),  and  the  interview  (FAR 
15.102).  The  FAR  addresses  prioritization  of  alternatives  in  15.305  Proposal  evaluation: 

Proposal  evaluation  is  an  assessment  of  the  proposal  and  the  offeror’s  ability  to  perform 
the  prospective  contract  successfully.  An  agency  shall  evaluate  competitive  proposals 
and  then  assess  their  relative  qualities  solely  on  the  factors  and  subfactors  specified  in 
the  solicitation.  Evaluations  may  be  conducted  using  any  rating  method  or  combination 
of  methods,  including  color  or  adjectival  ratings,  numerical  weights  and  ordinal  rankings. 
The  relative  strengths,  deficiencies,  significant  weaknesses,  and  risks  supporting 
proposal  evaluation  shall  be  documented  in  the  contract  file. 

However,  the  Army  FARS  has  the  following: 

5115.304 — Evaluation  Factors  and  Significant  Subfactors 

(iv)  Must  be  qualitative.  Numerical  weighting  (i.e.,  assigning  points  or  percentages  to 
evaluation  factors  and  subfactors)  is  not  an  authorized  method  of  expressing  the  relative 
importance  of  these  factors  and  subfactors.  Evaluation  factors  and  subfactors  must  be 
definable  in  readily  understood  qualitative  terms  (i.e.,  adjectival,  colors,  or  other  indicators, 
but  not  numbers)  and  represent  the  key  areas  of  importance  to  be  considered  in  the  source 
selection  process.  The  direction  of  this  subparagraph  is  not  waivable,  either  on  an  individual 
or  class  basis,  as  an  AFARS  deviation. 

Therefore,  when  selecting  a  contractor,  AFARS  Best  Value  process  must  not  use  either 
weights  or  the  ratings  on  any  of  the  evaluation  factors  must  have  qualitative  ratings.  The  impact 
of  this  policy  is  the  lack  of  transparency  but  also  prevents  protests  due  to  the  inability  or  difficulty 
to  challenge  a  subjective,  nontransparent  system.  The  downside  to  this  type  of  system  is  that  it 
motivates  owner  representatives  to  make  decisions  instead  of  allowing  the  contractors  to 
determine  who  gets  the  project  based  on  a  preset  system  that  is  very  predictable.  However, 
Best  Value/PIPS  can  still  be  run  using  qualitative  ratings  on  past  performance,  risk 
assessment/value  added  submittal,  and  interviews. 

The  major  contribution  of  Best  Value/  PIPS  is  in  the  Preplanning/QC  phase  and  the  Risk 
Management  phase.  These  two  phases  can  be  written  into  the  IDIQ  specification.  The  phases 
provide  the  user  with  relevant  information  related  to  the  contractor’s  performance.  These 
components  are  not  a  procurement  issue,  but  a  client’s  requirement  to  ensure  wise  usage  of 
their  funding.  This  responsibility  must  be  fulfilled  and  is  periodically  checked  by  auditors  to 
ensure  the  funds  are  receiving  the  best  value  for  the  government. 

Resistance  to  Change 

The  movement  to  Best  Value  is  threatening  to  the  status  quo  due  to  the  following: 

1 .  The  contractor  becomes  the  expert,  the  center  of  the  universe,  the  most  important 
component  of  the  value  chain,  replacing  the  perch  the  procurement  officer  has  in  the 
low-bid  environment. 

2.  Best  Value/  PIPS  forces  the  government  to  release  control  to  the  outsourced  vendor.  It 
is  difficult  for  procurement  agents  to  release  control. 
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3.  If  services  are  outsourced,  and  the  process  becomes  more  efficient  and  effective,  the 
government  will  need  less  personnel  to  make  it  work.  This  threatens  the  procurement 
community,  whose  members  may  feel  that  their  jobs  are  being  eradicated. 

4.  A  change  in  culture  brings  fear  to  the  government  community.  This  fear  is  exhibited  in 
many  ways:  resistance  to  change,  not  being  open  to  logic/best  practices,  using  the  FAR 
and  AFARS  and  interpreting  new  concepts  as  illegal,  increasing  transaction  costs  of 
other  participants  in  the  delivery  chain,  and  not  acting  in  the  best  interest  of  the 
government. 

Resistance  to  using  the  Best  Value/PIPS  process  has  included: 

1 .  Stating  that  Arizona  State  University  could  not  be  used  to  replace  the  COE  procurement 
process.  This  is  a  fear  that  is  totally  unjustified.  ASU  is  a  research/education  group. 
ASU  does  not  participate  in  the  procurement  selection. 

2.  Best  Value/PIPS  will  only  quantify  contractors  with  past  performance.  This  is  incorrect. 

If  a  contractor  has  no  past  performance  ratings,  the  client  is  instructed  to  rate  them  an 
average  rating.  This  rating  is  called  “I  don’t  know.”  The  contractor  could  be  a  very  high 
performer  based  on  the  owner’s  past  experience;  however,  the  client  should  not  bias  the 
system  by  making  a  decision  and  helping  a  contractor  get  in. 

3.  The  past  performance  is  only  good  past  performance.  In  order  to  win  a  true  best-value 
RFP,  the  contractor  must  send  their  best  people,  and,  therefore,  their  best  past 
performance.  In  this  case,  the  best  past  performance  is  indicative  in  the  way  the  best 
value  will  operate.  This  minimizes  client  decision-making,  forces  the  competition  among 
performers,  and  allows  the  transfer  of  risk  to  the  best  performer. 

4.  Risk-assessment  plans  are  general  and  ambiguous.  As  contractors  get  grounded  into 
the  system  of  identifying  the  risks  that  they  do  not  control,  the  risk  plans  will  get  better. 
However,  they  can  only  add  to  the  contractor’s  preplanning  and  thinking  and  do  not  act 
as  a  detriment. 

5.  Interviews  should  focus  on  technical  matters.  In  order  to  rate  contractors  on  technical 
matters,  the  government  has  to  be  the  expert,  make  decisions,  and,  therefore,  absorb 
the  risk.  This  system  has  proved  to  be  unsuccessful.  Contractors  who  can  answer 
concerns  simply,  in  non-technical  language,  are  high  performers.  Poor  performers 
cannot  simplify. 

6.  There  is  a  lack  of  competitive  range  and  discussions.  The  competitive  range  should  be 
identified  by  the  best  values. 

7.  The  scope  of  the  project  should  not  be  published  in  terms  of  budgets.  Best  Value/PIPS 
encourages  giving  the  budget  to  the  contractors  so  they  may  determine  risk.  However, 
giving  the  budget  is  not  mandatory.  Not  giving  the  budget  often  helps  the  low  bidders 
who  gain  the  advantage  with  low  price.  High  performers  always  minimize  risk,  and  if  any 
information  is  withheld,  the  risk  increases,  and  the  high  performers  increase  their  prices. 

8.  Sharing  of  offerors’  risk  plans  with  other  contractors  is  not  required. 
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Conclusion 

Best  Value/PIPS  is  a  cultural  revolution  for  the  government.  The  process/structure  has 
been  well  tested  over  an  extended  period  of  time.  Best  Value/PIPS  requires  the  procurement 
agents  to  release  control,  minimize  decision-making,  minimize  the  creation  of  transaction  costs, 
and  change  their  thinking.  Education  is  the  key.  The  government  needs  to  become  more 
efficient  and  effective. 
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2003  -  2006  Sponsored  Acquisition  Research  Topics 

Acquisition  Management 

■  Software  Requirements  for  OA 

■  Managing  Services  Supply  Chain 

■  Acquiring  Combat  Capability  via  Public-Private  Partnerships  (PPPs) 

■  Knowledge  Value  Added  (KVA)  +  Real  Options  (RO)  Applied  to  Shipyard 
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■  BCA:  Contractor  vs.  Organic  Growth 
Contract  Management 

■  USAF  IT  Commodity  Council 

■  Contractors  in  21st  Century  Combat  Zone 

■  Joint  Contingency  Contracting 

■  Navy  Contract  Writing  Guide 

■  Commodity  Sourcing  Strategies 

■  Past  Performance  in  Source  Selection 

■  USMC  Contingency  Contracting 

■  Transforming  DoD  Contract  Closeout 

■  Model  for  Optimizing  Contingency  Contracting  Planning  and  Execution 
Financial  Management 

■  PPPs  and  Government  Financing 

■  Energy  Saving  Contracts/DoD  Mobile  Assets 

■  Capital  Budgeting  for  DoD 

■  Financing  DoD  Budget  via  PPPs 

■  ROI  of  Information  Warfare  Systems 

■  Acquisitions  via  leasing:  MPS  case 

■  Special  Termination  Liability  in  MDAPs 
Logistics  Management 

■  R-TOC  Aegis  Microwave  Power  Tubes 

■  Privatization-NOSL/NAWCI 

■  Army  LOG  MOD 
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PBL  (4) 

Contractors  Supporting  Military  Operations 
RFID  (4) 

Strategic  Sourcing 

ASDS  Product  Support  Analysis 

Analysis  of  LAV  Depot  Maintenance 

Diffusion/Variability  on  Vendor  Performance  Evaluation 

Optimizing  CIWS  Lifecycle  Support  (LCS) 


Program  Management 


Building  Collaborative  Capacity 

Knowledge,  Responsibilities  and  Decision  Rights  in  MDAPs 
KVA  Applied  to  Aegis  and  SSDS 

Business  Process  Reengineering  (BPR)  for  LCS  Mission  Module  Acquisition 
Terminating  Your  Own  Program 
Collaborative  IT  Tools  Leveraging  Competence 


A  complete  listing  and  electronic  copies  of  published  research  within  the  Acquisition 
Research  Program  are  available  on  our  website:  www.acauisitionresearch.org 
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Best  Value/  PI  PS  Delivery  of 
Construction 


•  ASU  known  worldwide  as  a  leader  in  Best- Value  Procurement 

-  Conducting  research  since  1994  ($6.2M) 

-  484  procurements 

-  $521  Million  in  construction  services 

-  42  different  clients  (public  &  private) 

-  98%  customer  satisfaction 

-  Decreased  management  functions  by  80% 

-  Cl  B  TG  61  creators  and  coordinators 

-  China,  Malaysia,  Netherlands,  UK,  Finland,  Africa 


THE  CONSTRUCTION  WEEKLY 


Best  Value/ PI  PS 


•  Meets  legal  conditions  of  FAR/AFARS 

•  Transfers  risk,  minimizes  management. 


holds  all  parties  accountable 


Research  Clients 


Past  Research  Clients 


•  I  ntel 

•  Boeing 

•  Motorola 

•  I  nternational  Rectifier 

•  IBM 

•  Federal  Aviation  Administration 

•  US  Coast  Guard 

•  State  of  Utah 

•  State  of  Georgia 

•  State  of  Hawaii 

•  Department  of  Transportation,  HI 

•  University  of  Hawaii 

•  Dallas  I  ndependent  School  District 


•  US  Army  Medical  Command 

•  AFMC 

•  City  of  Peoria,  AZ 

•  City  of  Miami  Beach,  FL 

•  Baptist  Health  South  Florida,  FL 

•  State  of  Washington 

•  State  of  Missouri 

•  State  of  Wyoming 

•  General  Dynamics 

•  United  Airlines 

•  University  of  Minnesota 

•  Entergy,  Southern  US 

•  Schering  Plough 

•  Neogard 

•  TREMCO 

•  Heijmans,  Netherlands 

•  Ministry  of  Transportation,  Netherlands 

•  Arizona  State  University 

•  School  Facilities  Board,  State  of  Arizona 


Performance 


I  ndustry  Structure 


High 


III.  Negotiated-Bid 

Owner  selects  vendor 
Negotiates  with  vendor 

Vendor  performs 

II.  Value  Based 

Best  Value  (Performance 
and  price  measurements) 

Quality  control 

Contractor 
minimizes  risk 

IV.  Unstable  Market 

1.  Price  Based 

Specifications,  standards 
and  qualification  based 

Management  &  Inspection 

Client 

minimizes  risk 

Low 


Competition 


High 


I  mpact  of  Minimum  Standards 


High 

Low 

Contractor  1 

a> 

u 

c 

Contractor  2 

fO 

* 

E 

in 

L. 

€ 

Contractor  3 

Q. 

Low 

Contractor  4 

High 

High 


o 

u 

c 

m 

£ 

L. 

€ 

2. 


Low 


Contractor  1 


■  ■  ■  Contractor,  ^  ■  ■  ■  ■ 


Contractor  3 
Contractor  4 


* 

U) 


Low 


High 


I  ndustry  performance  and  cap 


Customers 


Outsourcing 

Owner 


Partnering 

Owner 


Price 

Based 


Vendor  X 


Best  Value  System 

Performance  I  nformation  Procurement 
System  ( PI  PS) 


PHASE  1 : 

PHASE  2: 

PHASE  3: 

SELECTION 

PRE-PLANNING 

QUALITY 

CONTROL 

MANAGEMENT 
BY  RISK 
MINIMIZATION 

II 


Performance  I  nformation 
Procurement  System  ( PI  PS) 


Filter  1 

Past 

Performance 


Filter  2 

Proposal  & 
Risk  /  Value 


Filter  3 

I  nterview 


Filter  4 

Prioritize 
( I  dentify 


Filter  5 

Pre-Award 

Phase 


Filter  6 

Weekly 
Report  & 


Time 


There  is  something  wrong  with  th 
delivery  of  services . 


No  one  knows  how  bad  the 
problem  really  is . 


Entire  system  is  broken .... 

Requires  more 
management.... 

Performance  is  decreasing 

Relationships  are  more 
important  than  results.... 
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Regulatory 
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tr 


- 


i- 


1  J 


fa 


Leverage  is  not  efficient 


•  All  forms  of  leverage  are  inefficient 

•  Minimizes  profit 

•  I  ncreases  stress 

•  Creates  an  adversarial  climate 


Best  Value  allows  freedom  and  the 
transfer  of  risk 

So  long  as  effective  freedom  of  exchange  is 
maintained,  the  central  feature. ..is  that  it  prevents  one 
person  from  interfering  with  another  in  respect  of  most 
of  his  activities.  I  ndeed,  a  major  source  of  objection  to 
a  free  economy  is  precisely  that  it  does  this  task  so 
well.  1 1  gives  people  what  they  want  instead  of  what  a 
particular  group  thinks  they  ought  to  want.  Underlying 
most  arguments  against  the  free  market  [and  best  value] 
is  a  lack  of  belief  in  freedom  itself. 

Milton  Friedman 


More  from  Milton  Friedman 


•  “I  am  in  favor  of  legalizing  drugs. .  ..Most  of  the  harm  that  comes  from 
drugs  is  because  they  are  illegal. 

•  If  you  put  the  federal  government  in  charge  of  the  Sahara  Desert,  in  5 
years,  there'd  be  a  shortage  of  sand. 

•  Most  of  the  energy  of  political  work  is  devoted  to  correcting  the  effects  of 
mismanagement. . .. " 


Minimize  Management,  Control, 
Directives 


•  Used  by  all  parties 

•  Should  be  minimized  by  everyone 

•  Creates  transaction  costs 

•  Creates  confusion 

•  Does  not  lead  to  continuous  improvement 


General  Rule 


•  If  it  isn't  a  win-win,  it  isn't  possible 

•  If  it  makes  someone  look  like  they  are  not  doing  their  job,  you  shouldn't  copy  the 
world 

•  Problems  are  usually  misunderstandings  and  an  unrealistic  view  of  the  event 


If  someone  isn't  doing  their  job,  it  is  usually  out  of  ignorance 


As  management,  control,  and  direction 
become  more  important . 


....it  becomes  less  important  to  be  skilled, 
accountable,  and  able  to  minimize  risk 


Don't  Mess  With  It! 


YOU  IDIOT! 


Anyone  Else 
Knows? 


You're  SCREWED! 


Can  You  Blame 
Someone  Else? 


Look  The  Other  Way 


Hide  It 


“Manager's  Code" 
The  movement  of  risk 


NO  PROBLEM! 


Who  do  the  client’s  professionals  feel 
more  comfortable  working  with? 


High  Performing 
Contractor 


% 


Low  Performing 
Contractor 


I  nformation  Environment 

•  Minimize  documentation/ information  flow 

•  Minimize  decision  making 

•  Look  for  dominant  information 

•  Minimize  work  for  everyone 

•  Transfer  risk  to  someone  who  can  minimize  risk 


Structure  Forces  Performance 


Low  Bid 
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Procurement 


Designer 


I  Dl  Q  Vendor 


Subcontractor 


Key 


Best  Value 


\SM  Risk 


Interface 


Risk  in  the  seams  where  only 
perceptive  people  see. 


Best  Value  System 

Performance  I  nformation  Procurement 
System  ( PI  PS) 


PHASE  1 : 

PHASE  2: 

PHASE  3: 
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QUALITY 

CONTROL 

MANAGEMENT 
BY  RISK 
MINIMIZATION 

II 


Preplanning/ Quality  Control 

Pre-Award  Period 


Closeout  Documentation 


Unforeseen  Risks 


QUALITY  CONTROL 

Risk  . . 

Risk  Minimization 
Schedule 


WEEKLY  REPORT 

Risk 

Unforeseen  Risks 


QUALITY  ASSURANCE 

PERFORMANCE  SUMMARY 

•  Checklist  of  Risks 

•  Vendor  Performance 

•  Sign  and  Date 

•  Client  Performance 

•  Individual  Performance 

.  •  Project  Performance 

Risk  Management  by  Contractor 


Director 


Contractor  4 


Division  Overview 


DIVISION  OVERVIEW 

2/3/2006 

Total  Awarded  Budget 

$100,000,000 

Current  Cost 

$120,000,000 

Over  Budget 

$  20,000,000 

PROJ  ECT  OVERVI EW 

Total  Number  of  Projects 

100 

%  Projects  Completed  On  Time 

90% 

#  of  J  obs  Delayed 

10 

%  Projects  Completed  On  Budget 

90% 

#  of  J  obs  Over  Awarded  Budget 

10 

AVERAGE  PROJ  ECT 

Project  Budget 

$  1,000,000.00 

#  of  Days  Delayed 

20 

Number  of  overdue  risks 

2.1 

Owner  Rating 

9.8 

Risk  Number 

1.56 

Top  Risks 


No. 

Project 

Rating 

1 

Project  1 

8.00 

2 

Project  2 

7.56 

3 

Project  3 

4.32 

4 

Project  4 

3.20 

5 

Project  5 

3.01 

6 

Project  6 

2.75 

7 

Project  7 

2.20 

8 

Project  8 

2.16 

9 

Project  9 

1.18 

10 

Project  10 

1.17 

Contractors 


CONTRACTOR  OVERVIEW 

A 

C 

D 

F 

B 

E 

Total  Awarded  Budget 

$6,020 ,317.04 

$13,564,350.92 

$79,631 ,067.55 

$66,890,916.82 

$45,920,051.27 

$47,666,021.99 

Current  Cost 

$6,045,317.04 

$14,306,152.85 

$81 ,484,864.64 

$66,890,916.82 

$45,941,515.48 

$47,976,259.39 

OVERVIEW  OF  PROJECTS 

Total  Number  of  Projects 

10 

16 

48 

22 

30 

14 

%  Projects  On  Time 

70% 

56% 

65% 

73% 

87% 

93% 

#  of  Jobs  Delayed 

3 

7 

17 

6 

4 

1 

%  Projects  On  Budget 

60% 

56% 

73% 

100% 

93% 

71% 

#  of  Jobs  Over  Awarded  Budget 

2 

7 

13 

0 

2 

4 

AVERAGE  PROJECT 

#  of  Risks  per  Job 

4.10 

6.44 

2.02 

5.32 

1.13 

6.50 

Owner  Generated  Risks 

0.70 

3.19 

1.25 

4.41 

1 

3 

Number  of  overdue  risks 

0.00 

0.44 

0.23 

0.32 

0.03 

0.29 

%  Over  Awarded  Budget 

5.78% 

30.02% 

2.21  % 

0.00% 

0.03% 

0.86% 

%  over  budget  due  to  owner 

4.42% 

29.97% 

1 .67% 

0.00% 

0.01  % 

0.33% 

#  of  Days  Delayed 

8.00 

43.50 

66.92 

20.18 

27.00 

5.29 

#of  days  delayed  due  to  owner 

2.60 

43.50 

53.17 

20.18 

24.00 

3.79 

Owner  Rating 

10.00 

8.58 

8.23 

9.06 

9.37 

9.64 

Risk  Number 

7.09 

4.30 

4.04 

2.18 

2.06 

1.61 

PM/ PI  Performance  Line 


OVER VI EW 

PM  1 

PM  2 

PM  3 

Total  Awarded  Budget 

$50,000,000 

$10,000,000 

$45,000,000 

Current  Cost 

$51,250,000 

$10,000,000 

$45,800,000 

Over  Budget 

$1,250,000 

$0 

$800,000 

OVERVI  EW  OF  PROJ  ECTS 

Total  Number  of  Projects 

15 

3 

6 

%  Projects  Completed  On  Time 

87% 

100% 

83% 

#  of  J  obs  Delayed 

2 

0 

1 

%  Projects  Completed  On  Budget 

93% 

67% 

100% 

#  of  J  obs  Over  Awarded  Budget 

1 

1 

0 

AVERAGE  PROJ  ECT 

Project  Budget 

$3,333,333 

$3,333,333 

$7,500,000 

%  Over  Awarded  Budget 

2.5% 

0.0% 

1.8% 

#  of  Days  Delayed 

15 

0 

11 

Number  of  overdue  risks 

0.51 

1.20 

0.92 

Owner  Rating 

9.81 

9.71 

10.00 

Risk  Number 

1.80 

1.40 

1.03 

Benefits  of  Thinking  as  a  Supply 
Chain 


Dallas  Independent  School  District 


School 

Budget 

1st 

2nd 

3rd 

4th 

5th 

6th 

Edison 

$1,153,634 

Cont  A 

Cont  B 

Cont  C 

Cont  G 

Cont  H 

$875,818 

jy  084  719 

$1,133,200 

$1,017,998 

$1,835,664 

Carver 

$548,347 

Cont  A 

Cent  B 

Cont  C 

Cont  G 

Cont  H 

Cont  L 

$474,418 

1311,540 

$541,300 

$545,820 

$461,415 

$560,000 

Madison 

$587,336 

Cont  A 

aesBiCofrts@aMBi 

Cont  C 

Cont  G 

Cont  H 

$878  7QQ 

i  $7H8  871 

$589,300 

$673,276 

$936,517 

ffIW  ,  1r  tf  t t  4  1t  m  1t1 ^  » 

Johnston 

$71  fi  Q9 8 

Cont  K 

Cont  A 

Cont  C 

Cont  G 

Cont  H 

$509,719 

$635,000 

$580,846 

$790,663 

Donald 

$175,576 

com  m 

Cont  K 

Cont  G 

Cont  C 

Cont  H 

$187,054 

$155,694 

$178,000 

$186,498 

$244,700 

$281 ,746 

Long 

$437,080 

Cont  A 

Cont  B 

Cont  C 

Cont  G 

Cont  H 

$425,281 

$529,801 

$501,500 

$512,752 

$875,750 

Foster 

$434,444 

Cont  B 

Cont  A 

Cont  K 

Cont  G 

Cont  C 

Cont  H 

$352,770 

$328,086 

$388,502 

$595,900 

$608,617 

Auburn 

$434,120 

Cont  B 

Cont  A 

Cont  K 

Cont  G 

Cont  C 

$406,531 

$365,981 

$533,000 

$420,989 

$487,700 

Macon 

$336,892 

Cont  B 

Cont  A 

Cont  C 

Cont  G 

Cont  H 

$366,445 

$295,739 

$334,200 

$397,600 

$353,588 

$373,174 

Comstock  Hall 

•  Scope  =  Replace  existing  lighting  fixtures 

•  Budget  =  $180,000 

i 

1st  2nd  3rd  4th 


No 

Criteria 

CH04 

CH03 

CH02 

CHOI 

1 

Price 

$  72,400 

$  70,350 

$  87,850 

$  96,575 

2 

Risk  Assessment  Plan 

7.5 

5.8 

4.2 

2.7 

3 

Schedule 

35 

30 

35 

25 

4 

PPI  (1-10)  Average 

9.7 

9.6 

9.8 

9.6 

5 

PPI  (Jobs  &  People)  Average 

20 

18 

16 

23 

•  Awarded  to  Gephart  Electric 

-  Estimated  budget  $180,000 

-  Award  cost  $72,400  (-60%) 


Results: 

-  On  time 

-  No  cost  change  orders 

-  Client  highly  satisfied 


Physics  Tate  Building 


•  Scope  =  Chilled  water  lines 

•  Budget  =  $490,000 


1st  2nd  3rd 


No 

Criteria 

T1 

T3 

T2 

1 

Price 

$  465,700 

$  489,545 

$  538,500 

2 

Risk  Assessment  Plan 

8.1 

7.1 

2.3 

3 

Schedule 

75 

61 

120 

4 

PPI  (1-10)  Average 

9.6 

9.6 

9.8 

5 

PPI  (Jobs  &  People)  Average 

19 

24 

11 

•  Awarded  to  Metropolitan  Mechanical 

-  Estimated  budget  $490,000 

-  Award  cost  $465,700  (-5%) 

-  Award  schedule  87  days 


Results: 

-  On  time 

-  No  cost  change  orders 

-  Client  is  highly  satisfied 


Overall  Analysis 


•  16  Projects  Procured/ Awarded 


-  6  Electrical 

-  5  Mechanical 

-  5  Roofing 

•  13%  below  budget 

-  $4.9M  Budget 

-  $4.3M  Award 

•  10  projects  completed 

-  100%  Satisfaction 

-  9. 1/ 10  Average  Rati  ng 


No 

Project 

Trade 

Estimated 

Budget 

Awarded 

Cost 

1 

Comstock  Hall 

Electrical 

$180,000 

$72,400 

2 

Elliot  Hall 

Electrical 

$120,000 

$93,850 

3 

Masonic  Center 

Electrical 

$220,000 

$200,700 

4 

Middlebrook 

Electrical 

$120,000 

$68,400 

5 

Mondale  Hall 

Electrical 

$160,000 

$134,780 

6 

Parking  Ramps 

Electrical 

$168,000 

$192,185 

7 

Child  Care 

Mechanical 

$550,000 

$443,100 

8 

Cooke  Hall 

Mechanical 

$50,000 

$64,500 

9 

Lions  Chiller 

Mechanical 

$143,000 

$170,608 

10 

Mayo  Building 

Mechanical 

$52,000 

$46,525 

11 

Tate  Physics  Lab 

Mechanical 

$490,000 

$465,700 

12 

Andrew  Boss  Lab 

Roofing 

$120,000 

$178,440 

13 

Mayo  Building 

Roofing 

$850,000 

$893,861 

14 

Smith  Hall 

Roofing 

$1,250,000 

$947,296 

15 

Stakman  Hall 

Roofing 

$64,000 

$101,900 

16 

University  Office 

Roofing 

$410,000 

$225,395 

Total  $  4,947,000  $  4,299,640 


Project  Manager  Comments 


«1S 


UMN  Project  Managers  were  originally  skeptical  about  the 
process  (minimize  directions,  control,  management) 


•  UMN  PM  Observations: 

-  I  mmediate  change  in  attitude  from  vendors 

-  Although  the  Pre- Award  Period  takes  time  and  effort,  the  overall 
duration  of  procurement  was  the  same  (saved  a  lot  of  time  when 
dealing  with  RFI 's) 

-  PM  stated  he  spent  about  10%  of  the  time  managing  the  projects 
(90%  reduction  of  effort).  Nearly  all  issues  were  resolved  during  PA 
Period. 

-  Substantial  amount  of  time  saved  since  no  change  orders 

-  End  users/clients  were  asking  PM's  to  use  PI  PS  process  on  other 
projects 


Latest  I  mplementations  at  PBSRG 


•  $30M  /  year,  10  year  contract  for  food  services  at  Arizona  State 
University  (Ray  J  ensen)  -  process  has  changed  the  way  food  services  are 
delivered 

•  Partnering  with  National  Institute  of  Government  Purchasing,  Project 
Management  Institute  (PMI),  and  International  Facility  Management 
Association  (IFMA)  groups 


I  improvement  of  Best  Value/ PI  PS 


Factor 

- 1 

Positive  Differential  | 

1 

Confidence  in  vendor 

4.2 

2 

Knowledge  of  the  vendors’  capability,  before  contract  award 

4;2 

3 

Satisfaction  with  the  proposal  (expectation  of  “promises”  being  executed) 

4 

Understanding  of  project  risks,  before  the  contract  begins 

6.8 

5 

Ease  in  differentiating  between  vendors’  capabilities/values 

5.4 

6 

The  amount  of  pre-planning,  risk  minimizing,  and  value  added  by  the  vendor, 
before  contract  award 

6.6 

7 

The  process  is  logical 

2.2 

8 

The  process  transfers  a  large  amount  of  meaningless  information 

7 

9 

The  process  promotes  win-win  situations  (benefits  all  parties) 

5.6 

10 

The  process  imposes  unnecessary  management  and  decision  making  efforts  on  the  part  of  the  client 

4.8 

11 

The  process  creates  adversarial  relationships  (unaligned  interests/motives) 

6.4 

12 

The  process  encourages  risks  to  be  identified  by  all  parties 

7.2 

13 

The  process  transfers  risk  to  the  most  appropriate  party 

7.4 

14 

The  process  generates  a  contractually  binding  flow  of  efficient  communication, 
throughout  the  life  of  the  contract 

6.6 

15 

The  process  documents  performance  via  contractually  binding  measurements, 
which  create  accountability  for  all  parties  involved 

6.4 

16 

The  process  is  fair  for  all  parties  involved 

5.6 

17 

The  process  is  a  step  in  the  positive  direction,  in  the  world  of  service  procurement 

7.8 

Individual  Averages 

Differential  Between  Best  Value  and  Normal  Process 

5.81 

Financial  Criteria 


Incumbent  Awarded  vendor 

i  * 


B 


Commissions 


$30,254,170 


$60,137,588 


$64,000,000 


Capital  I  nvestment 


$14,750,000 


$20,525,000 


$12,340,000 


Equipment  Replacement  Reserve 


$  7,213,342 


$  4,100,001 


$  8,171,811 


Total 


$52,217,512 


$84,762,589 


$84,511,811 


Total  financial  distance  between  incumbent  and  awarded 
vendor  over  7  year  guaranteed  contract  with  potential  +3 

years: 

$  32.545.077 


Advantages 


•  Proven  delivery  structure  for  services  (non- technical) 

•  Measures 

•  Forces  preplanning  and  minimization  of  risk 

•  Attracts  the  best  contractors/ personnel 


I  ncreases  value  and  performance  at  the  lowest  price 


Comments  /  Questions 


WWW.  PBSRG.  COM 


